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Introduction: 

Ultrasonic  imaging  plays  an  important  role  as  an  adjunct  to  mammography  [1,2].  Ultrasound’s  real-time  nature, 
lack  of  ionizing  radiation,  and  relative  comfort  for  the  patient  make  it  an  attractive  choice  for  applications  which 
include  the  differentiation  of  fluid  filled  cysts  and  solid  masses,  differentiation  of  benign  and  malignant  lesions, 
and  guidance  of  needle  and  core  biopsy  procedures.  Recent  studies  have  even  shown  the  potential  of  ultrasound 
as  a  screening  tool,  especially  for  pre-menopausal  women  whose  radio-dense  breast  tissue  seriously  limits  x-ray 
mammography  [3].  In  both  differential  diagnosis  and  screening  applications  however,  ultrasound  image  quality 
is  limited,  with  high  levels  of  background  clutter  representing  a  significant  problem  in  many  patients. 

While  the  cause  of  high  background  clutter  and  poor  breast  image  quality  has  not  been  determined  with 
certainty,  it  is  widely  held  that  acoustic  velocity  inhomogeneities  in  breast  tissue  cause  defocusing  of  the 
acoustic  beam.  This  distortion  manifests  itself  through  mainlobe  broadening  and  increasing  sidelobe  levels. 
Numerous  researchers,  including  the  Principal  Investigator,  have  suggested  that  this  problem,  known  as  phase 
aberration,  might  be  corrected  through  the  application  of  compensating  time  delays  [4-6],  a  combination  of 
delay  and  amplitude  corrections  [7],  or  other  more  complex  techniques  [8-10].  While  proposed  phase  aberration 
correction  methods  have  been  shown  to  have  great  potential  in  ex  vivo  or  other  non  real-time  environments, 
there  has  been  limited  evidence  of  significant  clinical  image  improvement.  The  development  of  a  real-time 
phase  aberration  correction  system  at  the  GE  Global  Research  Center  has  shown  that  real-time  phase  correction 
is  possible,  however  in  vivo  results  using  1.5-D  arrays  show  contrast  improvements  of  only  about  3  dB  in  the 
abdomen  [11,  12].  This  unimpressive  outcome  may  result  from  imperfect  algorithm  optimization,  or  perhaps  a 
lower  level  of  in  vivo  phase  aberration  than  previously  suspected.  This  latter  hypothesis  is  supported  by  phase 
aberration  measurements  performed  at  Duke  University  which  indicate  in  vivo  phase  aberrations  of  only  ~25ns 
RMS  (Root  Mean  Squared)  with  a  3.5  mm  FWHM  (Full  Width  at  Half  Maximum)  [13].  The  limited 
improvements  of  real-time  phase  correction,  coupled  with  low  measured  aberrations,  suggest  that  phase 
aberration  may  not  represent  the  major  source  of  breast  image  degradation. 

If  phase  aberration  is  not  the  primary  factor  limiting  breast  image  quality,  then  what  is?  We  hypothesize  that 
localized  bright  scatterers  seriously  degrade  ultrasound  images  by  introducing  broad  image  clutter.  Figure  1 
shows  single  channel  Radio  Frequency  (RF)  echo  data  obtained  from  calcifications  in  the  thyroid  of  a  human 
subject  at  Duke  University.  A  focused  transmit  beam  was  used  and  RF  data  was  acquired  from  each  element  in 
a  1.5-D  array  consisting  of  approximately  1000  elements.  Figure  1  shows  data  from  one  row  of  this  array  after 
application  of  geometrically  determined  focal  delays.  At  least  three  clear  waveforms  are  visible  in  this  data  set, 
with  each  probably  resulting  from  a  single  calcification.  Although  summation  across  channels  to  form  an  RF 
image  line  would  amplify  the  echo  coming  from  directly  in  front  of  the  array,  it  would  not  entirely  eliminate  the 
two  other  visible  targets.  These  non-focal  targets  would  appear  in  this  image  line  as  clutter,  reducing  image 
contrast.  In  addition  to  the  three  dominant  calcification  wavefonns,  the  data  set  also  includes  echoes  from 
background  speckle.  These  background  echoes  also  include  discemable  off-axis  scatterers  that  undoubtedly 
generate  further  clutter  in  the  image.  Note  that  the  thyroid  data  presented  in  figure  1  is  similar  in  appearance  to 
breast  data  obtained  at  Duke.  In  the  breast  bright  off-axis  echoes  may  originate  from  Cooper’s  ligaments,  highly 
structured  glandular  tissue,  calcification,  fat-soft  tissue  interfaces,  or  other  tissue  structures. 

The  presence  of  bright  off-axis  scatterers  and  the  image  degradation  that  they  cause  is  not  surprising.  It  is  well 
known  that  the  acoustic  reflectivity  of  targets  within  the  body  covers  many  orders  of  magnitude.  It  is  precisely 
for  this  reason  that  manufacturers  employ  aggressive  apodization  to  reduce  sidelobe  levels  in  diagnostic 
ultrasound.  It  has  also  been  argued  that  harmonic  imaging  is  effective  at  improving  image  quality  because  it 
further  reduces  sidelobe  levels  and  therefore  reduces  the  spatial  spread  of  bright  targets.  The  detrimental  impact 
of  bright  scatterers  on  ultrasound  image  quality  is  recognized  in  experimental  data,  physical  intuition,  and  years 
of  experience  in  ultrasound  system  design. 
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Figure  1:  Single  channel  data  obtained  in  vivo  from  a  human  thyroid.  At  least  three  bright 
scatterers  (likely  microcalcifications)  are  visible.  While  one  target  lies  near  the  focus,  the  other 
two  are  off-axis  and  will  contribute  clutter  to  this  image  line.  Off-axis  targets  are  also  visible 
within  the  speckle  generating  background  echoes.  (Data  courtesy  Gregg  Trahey,  Duke 
University.) 

The  impact  of  a  few  bright  targets  in  an  otherwise  dim  image  has  been  well  studied  in  both  RADAR  and 
SONAR.  In  SONAR  the  detection  of  an  intentionally  stealthy  submarine  among  many  noisy  ships  requires 
separating  out  a  signal  that  is  orders  of  magnitude  below  the  signals  from  other  nearby  targets.  A  broad  variety 
of  adaptive  beamforming  algorithms  have  been  developed  for  this  scenario.  It  is  the  goal  of  this  research  project 
to  evaluate  the  potential  applicability  of  these  methods  in  medical  ultrasound. 
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Body: 

Summary  of  Accomplishments: 

Over  the  course  of  this  project  our  research  broadened  significantly  beyond  the  original  proposal.  Our  original 
goal  of  evaluating  and  improving  upon  the  Constrained  Adaptive  Beamformer  (CAB)  was  superseded  by  the 
development  of  an  entirely  new  fam  ily  of  algorithms  which  we  have  co  me  to  name  TONE  for  Time  Domain 
Optimized  Near-field  Estimator  [14].  TONE  has  been  experimentally  to  achieve  spatial  resolution  and  10  times 
better  than  conventional  imaging  methods.  Our  research  into  TONE  and  its  pot  ential  led  to  a  number  of  other 
associated  developments.  The  major  accomplishments  were: 

-  Development  and  application  of  a  new  cyst  resolution  metric  for  assessing  ultrasound  image  quality 

-  Development  of  a  new  class  of  FIR  beamformers 

-  Improvement  and  evaluation  of  adaptive  imaging  algorithms  based  loosely  on  SPOC 

-  Invention  and  testing  of  the  basic  TONE  algorithm  for  image  reconstruction 

-  Invention  of  diffuse  TONE  (dTONE)  to  enable  more  robust  imaging  of  real-world  targets 

-  Invention  of  the  quick  TONE  (qTONE)  algorithm  for  dramatically  faster  image  reconstruction 

-  Application  of  TONE,  dTONE,  and  qTONE  to  in  vitro  and  in  vivo  imaging 

-  Development  of  a  new  spline  based  method  of  simulating  ultrasound  propagation 

In  aggregate  these  accomplishm  ents  place  a  new  f  undamental  foundation  under  ultrasound  im  age  formation. 
We  now  realize  that  so  called  “physical  limits”  on  resolution  are  really  an  artifact  of  our  im  age  fonnation 
methods  and  that  by  employing  new  m  ethods  we  can  dram  atically  improve  image  quality.  We  have  also 
developed  an  array  of  tools  to  sim  ulate  ultrasound  beamforming  and  to  rigorously  compare  the  performance  of 
different  beamformers. 

The  FIR  beamforming  approach  developed  under  this  grant  is  patent  pendi  ng  and  has  been  licensed  from  the 
University  of  Virginia  to  Pocket  Sonics,  a  company  co-founded  by  this  gr  ant’s  Principal  Investigator.  Tw  o 
patents  are  currently  pending  to  prot  ect  the  TONE  and  qTONE  algorith  ms.  The  Principal  Investigator  is  in  the 
process  of  fonn  ing  a  com  pany  to  license  and  co  mmercialize  these  technol  ogies.  Together  these 
commercialization  efforts  indicate  a  st  rong  opportunity  to  apply  these  re  search  developments  to  im  prove 
clinical  treatment  and  diagnosis  of  breast  cancer. 

A  Metric  for  Assessing  Beamformer  Performance: 

The  literature  in  ultrasound  im  aging,  as  well  as  SONA  R  and  RADAR,  is  littere  d  with  novel  beam  forming 
strategies,  new  apodization  functions,  and  “optim  al”  imaging  strategies.  Unfortunately  traditional  m  easures  of 
beamformer  quality,  such  as  Full  W  idth  at  Half  Maxi  mum  (FWHM)  of  the  bea  mplot  are  n  ot  well  suited  to 
quantify  the  performance  of  medical  ultrasound  im  aging  systems,  where  true  point  targ  ets  are  rare,  but  diffuse 
targets  are  common.  This  disparity  has  m  eant  that  m  any  algorithms  that  appear  prom  ising  for  point  target 
imaging  are  not  useful  in  clinical  settings.  Som  e  time  ago  we  realized  that  a  new  measure  of  bea  informer 
performance  was  needed;  one  that  was  more  in  tune  with  clinical  problems. 

We  have  derived  a  novel  m  etric  for  quantifying  ultrasound  image  quality.  Unlike  traditional  measures,  such  as 
the  Rayleigh  resolution,  which  quantify  point  target  resolution,  our  metric  quantifies  the  contrast  of  an  anechoic 
cyst  as  a  function  of  cy  st  radius.  Cystic  contrast  is  a  m  uch  more  relevant  parameter  for  m  edical  ultrasound 
where  point  targets  are  rare  and  of  little  clinical  importance.  Our  first  paper  describing  this  new  m  etric  was 
published  in  April  2007  [15]. 

This  original  metric  was  somewhat  limited  in  that  it  on  ly  considered  the  impact  of  electronic  noise  through  a 
Signal  to  N oise  Ratio  (SNR)  on  the  summ  ed  echo  signal.  This  made  it  awkward  to  com  pare  the  impact  of 
apodization  on  SNR  directly,  as  it  did  not  explicitly  consider  the  SNR  on  i  ndividual  beamformer  channels.  We 
developed  a  new  cystic  resolution  m  etric  that  considers  individual  channel  SNR,  a  nd  therefore  allows  d  irect 
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comparison  across  various  apodizatio  n  functions.  This  metric  allows  the  designer  to  id  entify  “optimal” 
apodizations  that  incorporate  both  realistic  propagation  physics  and  the  impact  of  electronic  noise.  In  our  early 
work  with  this  m  etric  we  have  ide  ntified  a  tradeoff  between  idealized  image  contrast  and  e  lectronic  noise;  a 
tradeoff  that  we  have  not  seen  considered  explicitly  elsewhere.  A  paper  describing  this  metric  was  published  in 
2009  [16]. 

Conventional  Beamformer  Optimization: 

While  the  TONE  and  dTONE  algorithm  s  (described  in  deta  il  below)  offer  trem  endous  improvements  in 
resolution  and  contrast,  their  high  computational  cost  presents  a  challenge  to  short-term  ,  real-time 
implementation.  Further,  while  we  know  that  these  al  gorithms  significantly  outperform  existing  beamformers, 
we  do  not  know  that  such  conventiona  1  delay  and  sum  beamformers  are  “optimal”  in  the  sense  of  achieving  the 
best  possible  contrast  or  resolution.  Thus,  to  offer  a  better  chance  of  short-term  technology  gains  and  to  provide 
a  true  benchmark  for  comparison,  we  have  developed  two  novel  techniques  for  optimizing  conventional  delay 
and  sum  beamformer  performance.  These  techniques,  termed  Linear  C  onstrained  Least  Squares  (LCLS)  and 
Quadratically  Constrained  Least  Squares  (QCLS)  optim  ization  design  optim  al  beamformer  weights  using 
slightly  different  mathematical  criterion.  LCLS  minimizes  the  point  spread  function  energy  outside  a  given  cyst 
radius  while  maintaining  a  constant  gain  at  the  center  of  the  cyst.  This  technique  yi  elds  a  closed  form  solution 
that  makes  best  use  of  the  elem  ent  responses,  regardle  ss  of  system  non-idealities  including  limited  element 
angular  response,  near  field  variations,  and  finite  bandwidth.  The  second  t  echnique,  QCLS,  also  minimizes  the 
point  spread  function  energy  outside  a  gi  ven  cyst  radius,  but  constrains  the  energy  within  the  cyst  radius.  This 
technique  effectively  optimizes  the  cy  Stic  contrast  m  etric  and  therefore  should  optim  ize  image  quality.  The 
theoretical  underpinnings  and  simulation  validation  of  these  techniques  are  described  in  two  papers  published  in 
IEEE  Transactions  on  Ultrasonics,  Ferroelectrics,  and  Frequency  Control  [17,18]. 

The  FIR  Beamformer: 

The  LCLS  and  QCLS  design  technique  s  are  guaranteed  to  yield  optim  al  apodization  profiles  for  a  given 
imaging  system,  however  with  only  one  parameter  to  adjust  on  each  beamfor  mer  channel,  we  found  that  the 
optimal  performance  was  not  always  much  better  than  conventional  apodization.  As  we  reflected  upon  this,  we 
wondered  if  it  was  possible  to  define  a  beamformer  architecture  wherein  we  could  adjust  multiple  parameters  on 
each  channel  and  thereby  achieve  greater  gains  in  perfonnance.  The  beamfomer  architecture  we  envisioned  is 
shown  below  in  figure  2.  The  upper  panel  depicts  a  conventional  delay  and  su  m  beamformer  where  the 
parameters  W,  X,  and  Y  are  the  designed  apodizati  ons.  The  lower  panel  depicts  the  new  FIR  bea  mfomer 
architecture  in  which  a  3  tap  FIR  filter  is  plac  ed  on  each  beamformer  channel,  after  the  delay  stage.  (Note  that 
the  abbreviation  FIR  stands  for  Finite  Impulse  Response.)  In  this  beamformer  the  parameters  A,  B,  C,  ...  N,  and 
O  are  designed  in  the  numerical  optimization. 


Apodization 


►  A-Line 


Figure  2:  Conventional  and  FIR  beamformer  architectures.  The  upper  panel  depicts  a 
conventional  delay  and  sum  beamfomer  with  a  single  adjustable  apodization  value  per  channel. 

The  lower  panel  depicts  the  novel  FIR  beamformer  architecture  in  which  multiple  weights  are 
applied  to  each  channel.  In  this  particular  realization  three  filter  taps  are  used  on  each  channel, 
although  there  is  no  theoretical  limit  to  the  number  of  taps  that  can  be  applied. 

This  greater  degree  of  flexibility  afforded  the  FIR  beamfonner  yields  dramatic,  and  robust  increases  in 
perfonnance.  In  our  current  design  methodology  we  simply  apply  the  QCLS  design  method,  but  design  for 
multiple,  temporally  delayed  apodization  profiles  to  obtain  channel  dependent  FIR  filter  coefficients.  Because 
this  method  fonns  FIR  filters  on  e  ach  channel  it  is  able  to  effectively  perform  frequency  dependent 
beamforming  to  achieve  optimal  broadband  results.  Figure  3  shows  significant  experimental  improvements  in 
lateral  resolution  and  contrast  achievable  with  the  FIR  beamformer.  Note  that  the  FIR  beamfonner  achieves 
both  a  narrower  mainlobe  and  a  lower  sidelobe  level  than  conventional  beamforming.  These  benefits  have  a 
significant  impact  on  cystic  contrast,  improving  cystic  contrast  by  over  10  dB. 
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Figure  3:  Experimental  2D  PSFs  with  different  receive  apodization  functions  applied.  Each 
image  is  0.2  cm  axially  by  1.95  cm  laterally.  All  images  were  envelope  detected  and  log 
compressed  to  70  dB.  The  conventional  windows’  PSFs  suffer  from  high  sidelobes  and  wide 
mainlobes.  The  multi-tap  FIR-QCLS  apodization  functions  progressively  reduce  the  total 
sidelobe  energy  while  maintaining  a  tight  mainlobe  in  the  spatial  PSFs.  The  design  cyst  is  shown 
for  reference. 


We  further  assessed  the  perfonnance  improvements  of  the  FIR  beamfonner  by  convolving  the  experimentally 
obtained  point  spread  functions  with  simulated  cysts  within  a  speckle  generating  background.  The  simulated 
images,  shown  below  in  figure  4,  show  an  appreciable  improvement  in  cystic  contrast  with  FIR  beamforming. 
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Figure  4:  Simulated  B-mode  i  mages  of  a  1.0  mm  diameter  cyst  embedded  in  speckle  using  the 
experimental  PSFs.  All  im  ages  are  log  co  mpressed  to  30  dB  and  show  a  5  mm  by  5  mm  area 
surrounding  the  anechoic  cyst.  The  1.0  mm  diameter  cyst  is  shown  for  reference. 

Time-Domain  Optimized  Near-Field  Estimator  (TONE): 

For  nearly  four  decades,  adaptive  beamforming  (ABF)  algorithms  have  been  applied  in  RADAR 
and  SONAR  signal  processing.  These  algorithm  s  reduce  the  contribution  of  undesired  off-axis 
signals  while  maintaining  a  desired  response  alo  ng  a  specific  look  direc  tion.  Typically,  higher 
resolution  and  contrast  is  attain  able  using  adap  five  beamforming  at  the  price  of  an  increa  sed 
computational  load.  W  e  have  developed  a  novel  ABF  designed  for  m  edical  ultrasound,  named 
the  Time-domain  Optimized  Near-Filed  Estimator,  or  TONE.  The  novel  ABF  was  developed 
from  Spatial  Processing:  Optimized  and  Constrained  (SPOC)  technique  originally  developed  by 
Van  Trees  et  al.  for  applications  in  passive  S  ONAR  [20],  TONE  is  well  suited  to  medical 
ultrasound  since  it  requires  neither  a  far-field/narrow-band  assumption  nor  second  order  statistics 
of  the  signals.  As  seen  below,  TONE  shows  a  significant  improvement  in  resolution  and  contrast 
when  compared  to  conventional,  data  independent  beamforming. 
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TONE  Progress: 

The  region  of  tissue  to  be  im  aged  region  (the  region  of  interest  or  ROI),  is  subd  ivided  into  a  colle  ction  of 
hypothetical  targets  at  arbitrary  positions,  as  shown  in  (i  gure  5.  Finer  target  placem  ent  yields  finer  final  im  age 
resolution  but  entails  higher  computational  costs.  For  each  hypothetical  target  in  the  ROI,  we  model  the  sign  al 
received  by  the  array  for  that  spec  ific  point  (i.e.,  the  spa  tial  responses).  These  spatial  responses  can  be 
determined  using  a  theoretical  m  odel,  computational  model,  or  can  be  extracted  fr  om  experimental  data.  For 
every  hypothetical  target,  the  spatial  impulse  response  is  a  matrix  of  dimensions  TxN,  where  T  is  the  number  of 
samples  in  the  time  dimension  and  N  is  the  number  of  elements  in  the  array.  After  the  spatial  impulse  responses 
for  all  the  hypothetical  targets  have  been  calculated,  thes  e  responses  are  reshaped  to  for  m  an  array  m  anifold 

V  .  . 

matrix  —  of  dimensions  NTxLP,  where  L  and  P  are  the  numbers  of  hypothetical  sources  in  the  range  and  lateral 
dimensions,  respectively.  The  observation  model  then  becomes: 


x  =  Vf 


(1) 


x  =  [x,  x2 . x#]r  f 

where - —  is  the  data  received  by  the  N-elem  ent  array  and  —  is  the  LPxl  target  am  plitude 


vector,  whose  elements  are  the  amplitudes  of  the  hypothetical  targets  located  in  the  ROI.  -is  a  NTxl  vector  that 

X.  Y  V  y 

is  obtained  by  concatenating  the  Txl  channel  data  — .  Given  —  and  — ,  TONE  matches  the  received  data  -  to 

the  signal  model  to  solve  for  the  position  and  intensity  of  the  real  sources  (i.e.,  the  —  vector).  If  there  is  no  real 

source  at  a  particular  location  within  the  ROI,  then  the  element  of  —  that  corresponds  to  that  location  should  be 
zero.  Mathematically,  this  is  accomplished  by  solving  the  following  maximum  a  posteriori  (MAP)  optimization 
problem: 


Cost  function : 

M 

subject  to:  x - V_f 


(2) 


where  f  are  elements  of  — .  A  solution  for  the  MAP  optimization  problem  is  found  using  the  following  iterative 
procedure  described  by  K.  W.  Lo. 
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Generation  of  Array  Manifold  Matrix 

ROI  i  T  (i-i)i+j 


Field  of  Hypothetical  Spatial  Response  Array  Manifold  Matrix  ( V) 

Sources 


Application  of  Adaptive  Algorithm 


Data  Acquisition  Image  Reconstruction 


Figure  5.  Schematic  diagram  of  TONE. 

A  series  of  computer  simulations  were  performed  in  Matlab  to  test  the  potential  of  TONE.  These  simulations 
and  their  results  are  described  in  detail  below. 

Single  Point  Target  Simulations 

A  point  target  was  placed  directly  in  front  of  the  transducer  at  a  dept  h  of  20. 1mm.  We  si  mulated  a  33  element 
linear  array  operating  at  5  MHz  with  element  spacing  of  150  fm.  Signals  were  sampled  at  40  MHz.  Plane  wave 
transmission  was  used  for  conventional  beam  fonning  and  SPOC.  Conventional  beamfor  ming  was  applied  on 
the  received  RF  data  us  ing  Hann  apodization  and  dyna  mic  receive  focusing.  For  SPO  C,  we  discretized  the 
image  region  as  a  setof  hypothetical  targets  separated  20  fm  in  range  and  100  fm  in  azimuth. 


13 


0.2 


Azi 

mu 

th 

(c 

m) 


0.15 

0.1 

0.05 

0 

-0.05 

-0.1 

-0.15 

-0.2 


1.95 


2.05 


2.1 


(a) 


Range  (cm) 


Conventional  Delay  and  Sum  BF,  No 


TONE,  No  noise 


TONE,  30  dB  SNR  per  channel 


-0.2 

-0.15 

Azi 

-0.1 

mu 

-0.05 

th 

(c 

0 

m) 

0.05 

0.1 

0.15 

0.2 

(e) 

TONE,  20  dB  SNR  per  channel 


1.95  2  2.05  2.1 

Range  (cm) 


Figure  6.  Point  target  simulations.  The  point  target  is  depicted  in  (a);  (b)  shows  conventional 
delay-and-sum  beamforming,  whereas  images  (c)  to  (e)  show  SPOC  with  different  levels  of 
electronic  noise. 


Multiple  Point  Target  Simulations: 

A  series  of  point  targets  were  distributed  within  a  4x5mm  region  in  range  and  azimuth,  respectively.  In  this 
case,  we  simulated  a  33  element  linear  array  operating  at  5  MHz  with  element  spacing  of  150  fm.  The  final 
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sampling  frequency  was  set  at  40  MHz.  A  plane  wave  was  used  on  transmit  for  both  conventional  beamforming 
and  TONE.  Conventional  beamforming  was  applied  on  t  he  received  RF  data  using  Hann  apodization  and 
dynamic  receive  focusing. 

For  TONE,  we  discretized  the  image  region  in  a  set  of  hypothetical  target  locations  separated  20  fm  in  range 
and  120  fm  in  azimuth.  The  positions  of  the  points  were  chosen  so  that  some,  but  not  all  coincide  with  the 
positions  of  the  hypothetical  targets.  Results  are  encouraging  in  that  they  show  TONE  is  robust  to  differences 
between  true  target  location  and  model  target  location. 
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Figure  7.  Results  obtained  simulating  a  series  of  wire  targets.  The  wires  are  depicted  in  (a);  (b) 
shows  conventional  delay- and-sum  beamforming,  whereas  (c)  show  TONE. 

Anechoic  Cyst  Simulation: 

A  1mm  radius  anechoic  cyst  was  placed  in  front  of  the  array  and  surrounded  by  ultrasonic  scatterers  randomly 
distributed  within  the  image  region.  Scatterer  amplitudes  followed  a  Gaussian  distribution  with  zero  mean  and 
standard  deviation  of  one.  Simulation  methods  are  the  same  of  those  described  in  the  previous  section,  except 
that  the  hypothetical  source  sampling  was  reduced  to  100  fm  in  azimuth.  Again,  the  positions  of  the  scatterers 
do  not  necessarily  coincide  with  the  position  of  the  hypothetical  sources.  Results  indicate  that  SPOC  is  robust  in 
the  presence  of  large  numbers  of  targets  placed  at  intervals  closer  than  the  conventional  resolution. 
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Figure  8.  Results  obtained  simulating  an  anechoic  cyst  surrounded  by  scatterers.  The  cysts  is 
depicted  in  (a);  (b)  shows  conventional  delay-and-sum  beamforming,  whereas  (c)  show  TONE. 


Experimental  results: 

We  also  performed  a  series  of  experiments  using  a  commercially  available  Philips  SONOS  5500  imaging 
scanner  and  a  series  of  5  wires  suspended  in  a  water  tank.  The  wires  are  20  fm  in  diameter  and  spaced  roughly 
2mm  apart.  The  top  panel  of  figure  5  shows  the  image  generated  by  the  Philips  scanner,  whereas  the  bottom 
panel  shows  the  TONE  reconstructed  image.  In  the  case  of  TONE  we  discretized  the  image  region  in  a  series  of 
hypothetical  targets  separated  by  roughly  20  fm  in  both  range  and  azimuth.  Results  indicate  that  TONE  can 
perfonn  robustly  with  real  experimental  data.  Further  work  is  ongoing  to  test  TONE  in  excised  tissues. 
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Figure  9.  C  omparison  between  conventional  beamfonning  (top)  and  TONE  [formerly  called 
SPOC]  (bottom)  on  a  set  of  5  wires  suspended  within  a  water  tank.  The  wires  are  20 fm  in 
diameter. 

Diffuse  Target  TONE  (dTONE): 

One  of  the  limitations  of  TONE  is  that  it  assumes  that  the  imaged  targets  lie  at  discrete  locations  within  the 
body,  an  assumption  that  is  clearly  not  true  in  practice.  While  the  impact  of  this  assumption  can  be  mitigated  to 
some  extent  by  more  finely  sampling  the  hypothetical  target  grid,  this  approach  is  extremely  costly 
computationally.  Further,  in  our  experience  it  is  not  clear  that  the  costs  incurred  result  in  a  significantly  better 
image.  Because  of  the  coherent  nature  of  echo  summation,  a  true  target  lying  between  two  hypothetical  target 
locations  might  be  best  modeled  by  TONE  using  a  large  cloud  of  scatterers  spread  over  a  large  region  of  the 
reconstructed  image.  This  is  both  unsightly  and  not  useful.  To  deal  with  both  of  these  issues  we  have  developed 
a  new  variant  of  TONE  called  diffuse  target  TONE  or  dTONE. 

dTONE  reconstructs  the  image  in  exactly  the  same  manner  as  TONE,  but  by  using  a  slightly  array  manifold 

matrix  1  it  is  able  to  robustly  account  for  targets  that  do  not  lie  precisely  on  the  reconstruction  grid.  dTONE 
alters  the  array  manifold  matrix  by  assuming  that  the  signal  from  one  hypothetical  target  really  originates  from 
a  diffuse,  amplitude  weighted  group  of  targets  centered  about  the  hypothetical  target  location.  This  approach  is 
more  computationally  costly  in  the  formulation  of  the  problem,  i.e.  computation  of  the  array  manifold  and  later 
eigenvalue  decompositions,  but  has  absolutely  no  impact  on  the  computational  cost  of  the  reconstruction.  Since 
we  anticipate  that  the  array  manifold  formation  and  eigenvalue  decompositions  will  be  performed  offline,  this 
algorithm  represents  an  elegant  way  to  improve  performance.  When  we  reconstruct  a  d  TONE  image  we 
represent  the  targets  from  each  hypothetical  location  using  a  bi-cubic  spline.  This  approach  yields  a  smoother 
and  more  pleasing  image.  An  experimental  dTONE  image  is  compared  with  a  TONE  image  below  in  figure  10. 
The  dTONE  image  has  less  clutter  and  is  visibly  smoother. 
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Diffuse  TONE  Output  for  Five  Wires 


Figure  10.  Comparison  between  experimentally  fonned  TONE  and  dTONE  images. 

Simulation  Tool  Development: 

The  performance  of  TONE  depends  greatly  upon  the  quality  of  the  system  model  it  applies.  In  our  initial 
simulations  we  modeled  the  system  using  analytical  methods,  or  using  the  well  known  FIELD  program  written 
by  Jorgen  Jensen.  Unfortunately  FIELD  is  quite  slow  when  computing  full  3D  spatial  impulse  responses. 
Further,  because  FIELD  works  entirely  on  sampled  data  sets  it  is  prone  to  artifacts  from  undersampling.  We 
have  implemented  the  Tuphohne-Stepanishen  method  (the  core  approach  used  in  FIELD)  in  a  new  piece  of 
code  we  call  DELFI.  The  DELFI  code  uses  cubic  spline  representations  of  the  transmitted  pulse,  and  the 
transmit  and  receive  spatial  impulse  responses.  This  approach  avoids  the  potential  sampling  difficulties  of 
FIELD.  It  is  also  significantly  faster  at  computing  space-space-space  responses  at  an  instant  in  time.  These  sort 
of  responses  are  critical  in  much  of  our  research  and  the  25  fold  increase  in  speed  for  DELFI  is  of  great 
significance.  Our  paper  describing  the  DELFI  code  was  published  this  May  [19].  Some  results  from  this  paper 
are  shown  below  in  figure  1 1 .  N  ote  that  for  space-space  responses  DELFI  is  significantly  faster  to  achieve  a 
given  accuracy  level.  For  space-time  responses  DELFI  is  somewhat  slower,  but  can  achieve  high  accuracy  at 
significantly  lower  sampling  rates.  We  placed  the  final  version  of  our  DELFI  code  on  the  Mathworks  web  site 
just  after  our  paper  was  accepted  for  publication.  This  code  has  been  downloaded  over  200  times  since  then. 
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Figure  1 1 :  Simulation  results  comparing  the  speed  and  accuracy  of  DELFI  and  FIELD  (both 
rectangular  and  triangular  computational  elements)  for  space-space  and  space-time  responses. 
Note  the  high  accuracy  achieved  for  DELFI  at  even  low  sampling  rates. 
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Quick-TONE  (qTONE): 

In  order  to  further  the  computational  cost  of  dTONE  such  that  it  can  be  applied  to  in  vivo 
imaging,  a  change  in  the  core  algorithm  is  required,  leading  to  the  development  of  qTONE.  qTONE  shifts 
the  computational  cost  from  being  based  on  the  number  of  hypothetical  scatterers  to  being  based  on  t  he 
number  of  input  samples,  which  allows  for  significant  reductions  in  reconstruction  time  with  little  effect  on 
image  quality  (please  see  Appendix  1  for  details). 

In  the  final  stage  of  this  project  we  applied  the  qTONE  image  reconstruction  algorithm  to  in  vivo  imaging. 
The  attached  images  were  fonned  from  data  obtained  from  the  testicle  of  a  healthy  volunteer.  As  the  images 
show  clearly  (Fig.  12),  qTONE  images  yield  better  resolution  and  contrast  than  traditional  beamforming. 
Note  the  numerous  ducts  which  are  visible  in  the  qTONE  images  but  are  completely  absent  in  the 
conventionally  beamformed  images.  These  images  strongly  support  the  potential  clinical  value  of  qTONE 
imaging  (please  see  Appendix  2  for  details). 


CIR  Tiled  qTONE 
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CIR  Tiled  qTONE 


Figure  12.  In  vivo  CIR  and  tiled  qTONE  images  of  a  human  testicle.  All  images  log  compressed  to  50  dB. 


Experimental  Platform  Development: 

During  the  life  of  this  grant  we  shifted  our  experimental  work  almost  entirely  to  the 
Ultrasonix  Sonix  RP.  The  Sonix  RP  is  a  highly  programmable  research  platfonn  built  around  a  clinical 
ultrasound  imaging  system.  We  acquired  this  system  in  June  2006  and  have  since  implemented  a  broad  range 
of  tools: 

*  Python  scripting  interface  for  Ultrasonix,  to  allow  interactive  control  of  all  transmit/receive  sequences 
without  recompilation,  for  rapid  experiment  turnaround. 

*  Synthetic  receive  control  -  ability  to  receive  single  element  RF  data  on  successive  transmits. 

*  Synthetic  transmit  control  -  ability  to  transmit  on  single  elements. 

*  Automated  full  synthetic  transmit/receive,  this  lets  us  capture  full  synthetic  data  sets  from  a  128-element 
transducer  in  30  seconds. 

*  Automated  transducer  characterization  in  conjunction  with  hydrophone. 

*  Matlab  interface  for  execution  and  analysis  of  simple  sequences  in  a  single  script. 

*  Automated  averaging  of  repeatedly  captured  data  to  improve  SNR. 

While  we  have  made  tremendous  progress  in  developing  tools  for  system  control  and  data  acquisition,  our 
experimental  progress  is  hampered  by  the  poor  quality  of  the  transducer  arrays  currently  sold  for  the  Sonix 
RP.  These  transducers  exhibit  poorer  element  angular  response,  poorer  element  spacing,  and  poorer 
bandwidth  than  state  of  the  art  transducers.  To  circumvent  this  limitation  we  are  integrating  a  Philips  linear 
array  probe  with  the  Sonix  RP.  This  array  is  at  the  state  of  the  art  for  small  parts  imaging  and  when 
integrated,  will  be  recognized  by  the  Sonix  RP  as  native  and  thus  available  for  real-time  imaging  and 
programmed  data  acquisition. 


21 


Another  experimental  system,  not  described  in  the  original  proposal,  is  a  fully  custom  system  developed  in 
collaboration  with  two  other  investigators  at  the  University  of  Virginia  (John  A.  Hossack  and  Travis  N. 
Blalock.)  A  second  generation  of  this  system  is  being  assembled.  This  second  generation  system  will  utilize 
a  3600  element  2D  array  and  will  operate  at  a  5.0  MHz  center  frequency.  Data  from  all  channels  will  be 
acquired  in  parallel  in  real-time,  however  only  four  real  samples  will  be  acquired  by  each  channel.  Although 
the  data  acquisition  of  this  system  is  certainly  limited  in  some  ways,  we  believe  that  this  system  will  provide 
an  excellent  testbed  for  TONE. 


Corporate  Interactions: 

Our  work  on  TONE  has  great  potential,  but  presents  great  challenges.  We  have  been  assisted  in  these  efforts 
through  a  number  of  valuable  corporate  interactions. 

Our  experimental  work  was  originally  aided  through  technical  support  and  equipment  donations  from  Philips 
Medical  Systems.  Our  transition  to  the  Sonix  RP  system  has  of  course  been  supported  by  UltraSonix. 

TONE  is  extremely  challenging  to  implement  computationally  and  we  have  worked  closely  with  Interactive 
Supercomputing  to  test  the  algorithm.  They  have  provided  technical  support  to  enable  the  transition  of  our 
algorithms  to  their  Star-P  MATLAB  parallelization  software.  Interactive  Supercomputing  has  also  provided 
us  with  free  CPU  cycles  on  their  high-end  cluster. 


Key  Research  Accomplishments: 

•  Developed  and  published  a  new  metric  to  quantify  ultrasound  beamfonner  perfonnance. 

•  Developed  and  published  a  second  new  metric  that  accurately  combines  the  effects  of  cystic  contrast 
resulting  from  the  system  point  spread  function  and  noise  on  individual  beamfonner  channels. 

•  Developed  and  published  two  new  methods  for  optimizing  beamfonner  apodization  functions  (LCLS 
and  QCLS  design  methods.) 

•  Developed  anew  ultrasound  beamfonner  architecture  (FIR  beamfonner)  that  achieves  dramatic 
improvements  in  image  contrast  and  resolution. 

•  Developed,  tested,  and  published  a  new  adaptive  beamfonner,  the  TONE  algorithm. 

•  Developed,  tested,  and  published  a  variant  of  TONE,  dTONE  which  yields  smoother  images  with  higher 
contrast  and  fewer  artifacts. 

•  Developed  and  tested  another  variant  of  TONE,  qTONE  which  is  significantly  faster  and  yields 
improved  image  quality. 

•  Developed  and  published  a  new  approach  to  ultrasound  simulation  (DELFI). 

•  Developed  extensive  experimental  tools  for  imaging  and  data  acquisition  using  the  Sonix  RP. 

•  Integrated  a  high  frequency  linear  anay  probe  with  the  Sonix  RP  to  improve  image  and  data  quality. 

•  Built  and  expanded  collaborations  with  numerous  corporations  including  Philips  Medical  Systems, 
UltraSonix,  InnerVision,  and  PocketSonics. 

•  Filed  patent  applications  on  FIR  Beamfonning,  TONE,  and  qTONE. 

•  Licensed  the  FIR  Beamfonning  algorithm  to  PocketSonics  for  use  in  its  products. 
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Conclusions: 

This  research  has  shown  the  tremendous  potential  of  novel  image  reconstruction  methods.  F  IR 
Beamforming,  which  can  be  readily  implemented  in  current  imaging  systems,  yields  substantial 
improvements  in  image  contrast  and  resolution.  T  he  qTONE  reconstruction  algorithm  yields  dramatic 
improvements  in  image  resolution  and  contrast.  Further  work  will  be  needed  to  modify  qTONE  to  reduce 
computational  complexity  to  make  it  a  viable  real-time  imaging  tool.  Initial  work  implementing  the 
algorithm  on  graphics  processors  (GPUs)  strongly  suggest  that  real-time  imaging  with  these  methods  will  be 
feasible  in  a  few  years. 
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Abstract: 


We  have  previously  described  a  new  image  reconstruction  method  called  dTONE, 
which  significantly  increases  both  image  contrast  and  resolution  by  conducting  a  global 
optimization  based  on  a  model  of  sparse  hypothetical  scatterer  locations.  Due  to  the  large 
scale  and  0(n3)  computational  complexity,  images  of  clinically  significant  dimensions 
would  require  approximately  33  days  to  reconstruct  on  a  3  GHz  desktop  computer.  Here 
we  describe  an  alternate  algorithm  -  called  quick-TONE,  or  qTONE  -  that  provides  a 
significant  reduction  in  computational  cost  with  improved  image  contrast  under  the 
conditions  tested.  Both  methods,  along  with  conventional  image  reconstruction,  were 
applied  to  tissue  mimicking  phantoms  and  excised  animal  tissue.  For  the  model  used, 
qTONE  provided  an  8x  reduction  in  computation  time,  a  2.7x  reduction  in  memory 
requirements,  and  an  8  dB  improvement  in  cystic  contrast  over  the  dTONE  image. 


Introduction 


Unlike  conventional  image  reconstruction  (CIR)  techniques  in  ultrasound,  which 
throw  away  information  in  the  received  data  when  summing  across  channels,  adaptive 
image  reconstruction  (AIR)  methods  make  use  of  much  of  the  information  in  the  received 
data.  Doing  so  allows  AIR  techniques  to  achieve  resolutions  beyond  the  diffraction  limit 
along  with  improved  image  contrast.  These  enhancements  could  greatly  improve  the 
accuracy  and  precision  of  clinical  diagnoses  based  on  fine  tissue  structures  such  as  small 
hepatic  lesions  [1],  microcalcifications  [2,  3],  or  spiculation  [4].  However,  the  resolution 
and  contrast  improvements  of  AIR  methods  typically  come  at  the  cost  of  robustness  to 
noise  and  aberration  or  greatly  increased  computational  complexity. 

One  such  AIR  technique,  called  the  Capon  beamformer  [5],  has  previously  been 
applied  to  medical  ultrasound  with  moderate  success.  As  this  method  is  sensitive  to 
errors  in  the  assumed  wavelield  parameters  such  as  electronic  noise  and  aberrations, 
techniques  such  as  spatial  smoothing  [6,  7]  and  diagonal  loading  [8]  must  be  used  to 
increase  the  method’s  robustness.  While  these  modifications  do  greatly  increase  the 
robustness  of  capon  beamformers,  they  tend  to  significantly  cannibalize  the  improved 
resolution  and  contrast  such  that  there  is  little  to  no  improvement  over  CIR  methods  [9], 
In  addition,  capon  beamformers  for  medical  ultrasound  require  O(n)  calculations  for 
each  pixel  in  the  reconstructed  image,  where  n  is  the  number  of  channels  used  to  form  the 
image.  This  computational  burden  makes  real-time  imaging  unfeasible  in  the  algorithm’s 
current  state. 

We  have  previously  described  a  new  image  reconstruction  method  called  dTONE 
[10],  which  is  well  suited  for  ultrasound  image  reconstruction.  Rather  than  estimate  a  set 


of  apodization  weights  for  delay-and-sum  imaging,  this  source  localization  technique 
uses  an  entirely  different  reconstruction  framework  to  directly  estimate  the  scatterer  field, 
which  allows  it  to  achieve  even  greater  resolution  and  contrast  enhancement. 

However,  dTONE’s  resolution  and  contrast  improvements  come  at  the  cost  of  a 
high  computational  burden.  dTONE  images  of  clinically  significant  dimensions  would 
require  6.2  TB  of  memory  and  about  33  days  of  computation  on  a  3  GHz  processor.  CIR 
methods  reconstruct  images  at  upwards  of  30  frames  per  second,  visualizing  human 
tissue  in  real-time  and  providing  ultrasound  with  a  major  advantage  over  other  medical 
imaging  modalities,  especially  in  cardiology  applications.  For  these  reasons,  it  is 
important  that  dTONE  reconstructions  be  computed  as  close  to  real-time  as  possible.  We 
have  previously  described  a  method  to  reduce  computation  times  by  parallelizing  the 
algorithm  using  reduced  rank  sub-models  [11].  Using  this  approach  in  simulation  and 
experiment,  image  reconstruction  time  was  decreased  more  than  tenfold  using  8  sub¬ 
models.  A  similar  application  of  this  approach  to  in  vivo  imaging  would  bring 
reconstruction  time  down  from  about  33  days  to  3.3  days.  Greater  computational  gains 
could  be  achieved  using  more  sub-models  at  the  expense  of  reconstruction  image  quality. 

In  order  to  further  bring  down  the  computational  cost  of  dTONE  such  that  it  can 
be  applied  to  in  vivo  imaging,  a  change  in  the  core  algorithm  is  required.  Here  we 
describe  an  alternative  algorithm,  called  quick-TONE  (qTONE),  that  is  derived  from  the 
same  foundation  as  dTONE.  qTONE  shifts  the  computational  cost  from  being  based  on 
the  number  of  hypothetical  scatterers  to  being  based  on  the  number  of  input  samples, 
which  allows  for  significant  reductions  in  reconstruction  time  with  little  effect  on  image 
quality.  In  this  paper,  the  qTONE  algorithm  is  derived  and  applied  to  tissue  mimicking 


phantoms  and  excised  animal  tissue  to  demonstrate  its  advantages  over  dTONE  and  CIR. 
Although  qTONE  is  described  here  for  typical  transmit-receive  ultrasound  architecture,  it 
is  also  offers  potential  to  significantly  improve  resolution  and  contrast  in  other  image 
reconstruction  architectures  [12-14]  and  some  novel  passive  ultrasound  systems  [15-17]. 

Theory 

From  [18],  the  rate  limiting  step  in  the  TONE  algorithm  is: 

(  V  V1 

f  =  pH  T  P  PhT  P  f'  ill 

J  free,k  + 1  ^  free  1  k  1  fix  J  ^ 1  fix  1  k  1  fix  J  J  fix  '  1  ’ 

The  total  computational  cost  of  this  calculation  is  approximately  on  the  order  of  fix2 (out  + 
fix),  where  fix  is  the  number  of  non-zero  eigenvalues  of  V_H  V  -  which  is  at  most  equal  to 

the  number  of  channel-time  samples  -  and  out  is  the  number  of  hypothetical  scatterers  in 
the  output  image.  Here,  fix  is  partly  determined  by  the  scale  and  spacing  of  the 
hypothetical  scatterers  in  the  ROI,  binding  the  computational  cost  to  the  output  sampling 
of  dTONE.  A  decrease  in  the  size  of fix  would  substantially  decrease  the  computational 
requirements  of  the  reconstruction. 

One  simple  way  to  achieve  this  goal  is  to  adjust  the  cutoff  between  fix  and  free  - 
which  sum  together  to  equal  the  number  of  eigenvalues  of  VHV  -  such  that  some  of  the 

very  small  non-zero  eigenvalues  are  treated  as  free  parameters  instead  of  fixed.  As  long 
as  the  non-zero  eigenvalues  that  are  rounded  down  to  zero  are  small  to  begin  with,  there 
should  be  very  little  effect  on  reconstruction  quality.  This  method,  which  is  similar  to 
principle  component  analysis,  works  well  to  reduce  computational  complexity  but  is 
limited  in  its  efficacy  due  to  a  limited  amount  of  flexibility  before  image  degradation 


becomes  overly  apparent.  Empirical  observations  suggest  the  fix  parameter  can  be 
reduced  by  no  more  than  10%  before  image  degradation  becomes  noticeable. 
Considering  a  full  breast  image  would  require  approximately  33  days  to  reconstruct  on  a 
3  Ghz  processor,  far  greater  computational  cost  reductions  are  necessary  to  bring  TONE 
to  clinical  feasibility. 

qTONE  Derivation 

Ideally,  the  computational  cost  of  the  image  reconstruction  would  be  detached 
from  the  ROI  spatial  sampling  so  that  large  regions  could  be  finely  sampled  without  a 
significant  increase  in  computational  cost.  To  achieve  this  end,  the  TONE  algorithm  was 
reworked  from  its  foundation.  Recall  from  the  derivation  of  TONE  [19]: 

x  =  H  (2) 

where  x  is  the  NT  x  1  data  vector  received  by  the  N-element  array, /is  the  LP  x  1  target 
vector,  whose  elements  are  the  amplitudes  of  the  hypothetical  targets  located  in  the  ROI, 
and  V  is  the  NT  x  LP  system  model  matrix.  The  maximum  posterior  estimate  of/is  given 
by  [20]: 

/  =  max^  p([  \  x)  =  max£  A  p(x  I  f)p(f)  (3) 

where  p(x,f)  is  the  joint  probability  density  function  (PDF)  and  A  is  a  normalizing 
constant  that  does  not  affect  the  maximum  a  posteriori  estimate.  We  assume  that  the 
marginal  PDF  p(f)  is  known  a  priori  and  mathematically  expressed  as  a  zero-mean 


Gaussian  function  [2 1 ,  22] : 


p(f)  = 


1 


exp 


(4) 


Furthermore,  p(x\f)  is  equally  likely  for  every  /  that  satisfies  the  observation  model  in 
equation  (2).  Thus,  equation  (3)  reduces  to  the  following: 

/  =  maxy  p(f )  (5) 

which  is  referred  to  as  the  maximum  a  posteriori  (MAP)  estimate  of £. 

Rather  than  maximize  the  actual  PDF  p(j)  as  is  done  in  TONE,  we  recognize  that 
just  maximizing  the  exponent  should  achieve  the  same  purpose  through  a  mathematically 
simpler  means.  Following  on  (4)  and  (5),  after  negating  the  exponent  to  form  a  cost 
minimization  problem,  we  have: 

minimize  fHC^f  subject  to  x  =  V  f  (6) 


This  optimization  problem  is  common  in  literature  and  using  the  Langrangian  method 
[23],  we  solve  for  the  MAP  target  vector  as: 


f_  =  CjVj 
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V_CjV_H 


V1 

x 
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(7) 


The  introduction  of  a  regularization  term  will  aid  in  the  inversion  under  certain  difficult 
conditions  where  the  reconstructed  image  is  sparse: 


/  =c}vf 


r 

v_c}v_H 


+al 


(8) 


Starting  with  an  initial  guess,  /0 ,  this  can  be  solved  non-linearly  using  the  following 


iteration: 


f 


U=c,r 


VCh  f  +al_ 


(9) 


This  process  is  stopped  when  the  difference  between  successive  estimates  of  /  drops 
below  a  desired  threshold.  The  final  fk+l  is  then  reshaped  and  displayed  on  a  log  scale  as 
the  reconstructed  image. 

To  further  the  robustness  of  the  algorithm  we  include  additive  Gaussian  noise  in 
the  linear  model: 


x  =V  f  +n 


(10) 


where  n  is  the  length  LP  noise  vector.  Applying  this  new  model  to  (6)  yields  the  solution 
for  the  MAP  target  vector: 
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U 


=C  -  V 

k+l 


A 


-1 


VCEV"  +c„ 


(11) 


where  Cn  is  the  noise  covariance  matrix.  If  we  assume  Cn  =  al ,  we  arrive  at  the  general 

Tikhonov  regularized  [24]  form  as  given  in  (9).  This  Bayesian  solution  has  been 
successfully  applied  in  other  fields  such  as  magnetoencephalography  [25],  computed 
tomography  [26],  and  positron  emission  tomography  [27],  but  not  medical  ultrasound. 


Computational  Implications 

The  total  computational  cost  of  this  alternate  calculation,  called  quick-TONE,  or 
qTONE,  is  roughly  on  the  order  of  in2 {out  +  in),  where  in  is  the  number  of  input  sensor 


array  samples  and  out  is  the  number  of  hypothetical  scatterers  in  the  output  image;  as 
opposed  to  the  computational  cost  of  standard  dTONE,  which  is  fix2 (out  +  fix),  where  fix 
is  the  number  of  non-zero  eigenvalues  of  VHV .  At  first  glance,  qTONE  does  not 

provide  a  reduction  in  computational  cost  as  fix,  by  definition,  has  a  maximum  value 
equal  to  in.  However,  the  transfer  of  computational  dependency  from  fix  to  in  provides 
more  freedom  to  intuitively  reduce  the  computational  complexity.  Adjusting  the  balance 
between  fix  and  free  in  dTONE  provides  a  reduction  in  computational  cost  but  quickly 
results  in  image  degradation.  In  qTONE,  an  equivalent  reduction  in  the  number  of  input 
channel-time  samples  provides  the  same  reduction  in  computational  cost  with  far  less 
image  degradation. 

Additionally,  qTONE  has  far  lower  memory  requirements  than  dTONE, 
significantly  reducing  the  hardware  requirements  and  further  reducing  reconstruction 
time  due  to  reduced  memory  latencies.  The  memory  requirements  for  dTONE  are 
primarily  determined  by  the  total  number  of  hypothetical  sources  used  in  the 
reconstruction.  This  is  due  to  the  need  to  store  both  the  system  model,  V  ,  and  the  eigen 

decomposition  of  VHV  .  The  matrix  of  eigenvectors  is  square  with  the  dimensions  of 
each  side  equal  to  the  total  number  of  hypothetical  scatterers. 

Images  of  clinically  useful  dimensions  would  require  1 .2  TB  to  store  the  system 
model  in  memory  and  an  additional  5.0  TB  to  store  the  matrix  of  eigenvectors. 
Assuming  a  very  fast  408  GB/s  memory  bandwidth  (NVIDIA®  Tesla™  S1070),  12 
seconds  would  be  required  just  to  access  the  matrix  of  eigenvectors  as  opposed  to  the  2.8 
seconds  required  to  access  just  the  system  model.  As  the  computational  cost  is  reduced 


through  the  reduced  rank  tiling  approach  described  in  [28],  this  memory  related  latency 
becomes  increasingly  significant.  Assuming  40  tiles  and  a  system  capable  of  4  TFLOPS 
(NVIDIA®  Tesla™  SI 070),  computation  of  dTONE  without  latencies  would  take  about 
5.5  seconds.  Thus,  an  additional  6  second  memory  latency  would  more  than  double  the 
computation  time  for  image  reconstruction.  qTONE  removes  the  requirement  to  store  the 
matrix  of  eigenvectors  and  therefore  significantly  reduces  reconstruction  time  by 
reducing  memory  latencies  in  addition  to  the  direct  computational  cost  reductions 
described  above. 

Efficient  Computation  Cost  Reduction 

qTONE’ s  computational  benefits  come  from  a  robustness  to  reductions  in  the 
number  of  input  channel-time  data.  The  simplest  way  to  achieve  this  reduction  is  to 
directly  downsample  the  channel-time  data  temporally.  While  this  effectively  decreases 
the  reconstruction  time,  it  does  so  at  the  expense  of  image  quality  as  valuable  information 
for  the  reconstruction  is  discarded.  One  equally  simple,  yet  somewhat  more  robust 
method  is  to  downsample  the  channel-time  input  data  in  a  checker  or  pseudorandom 
pattern  through  both  time  and  channel  rather  than  just  temporally.  This  method  would 
maintain  more  temporal  information  at  the  expense  of  some  channel  information,  which 
has  been  shown  to  not  be  a  problem  for  tone  reconstruction  [18]. 

More  elegant  methods  for  reducing  the  size  of  the  channel-time  data  exist  that 
achieve  similar  computational  improvements  with  even  less  image  degradation.  In  order 
to  reduce  computational  complexity  while  maintaining  the  most  possible  channel-time 
information,  we  first  recognize  that  there  is  additional  information  in  the  sensor  data  that 


is  not  necessary  to  form  a  high  quality  reconstructed  image.  By  performing  a  singular 
value  decomposition  (SVD)  on  the  manifold  matrix,  V  ,  we  can  create  a  set  of  orthogonal 

vectors,  U  and  W  ,  and  their  associated  singular  values,  S . 

V  =  USWH  (12) 

Recalling  the  linear  model  from  (2),  we  can  substitute  for  V  to  get: 

x  =  (t/5WH)/  (13) 

Multiplying  both  sides  of  the  equation  by  U  1  and  rearranging  terms  yields: 

xp=Vpf  where  xp=U_~1x  and  V;)=(5W_H)  (14) 

So,  by  first  performing  an  SVD  on  the  system  model,  we  can  transform  the  sensor  data 
and  system  model  into  a  different  space  and  then  proceed  as  normal.  By  recognizing  that 
not  all  the  vectors  and  their  associated  singular  values  are  necessary  for  accurate 
reconstruction,  we  can  then  reduce  the  dimensionality  of  the  reconstruction.  Thus,  we 
threshold  the  singular  values  to  a  desired  level  -  typically  to  maintain  about  99%  of  the 
energy  -  and  remove  the  associated  basis  vectors.  The  resulting  reconstruction  has 
reduced  dimensionality  but  should  still  provide  accurate  image  reconstruction  as  it 
maintains  most  of  the  important  information  and  only  eliminates  the  least  important  data. 

Anechoic  cyst  phantom 

A  3  mm  diameter,  7  cm  long  cylindrical  anechoic  cyst,  surrounded  by  a  1  x  1  x  7 
cm  speckle-generating  region  was  formed  in  7%  acrylamide  gel.  The  1x1x7  cm  region 
of  acrylamide  gel  containing  Sephadex™  G-50  Superfine  scatterers  (GE  Healthcare)  was 


embedded  in  a  larger  block  of  acrylamide  gel  containing  no  scatterers  such  that  the  center 
of  the  cyst  was  at  a  depth  of  approximately  2  cm  from  the  top  of  the  phantom.  An 
Ultrasonix  Sonix  RP  system  employing  a  128  channel,  300  pm  pitch,  linear  array  was 
used  to  transmit  a  6.6  MHz,  60%  fractional  bandwidth  plane  wave  and  obtain  single 
channel  RF  data.  The  data  was  filtered  using  a  100-tap  FIR  filter  with  a  pass-band  from 
3-10  MHz,  demodulated  to  produce  an  IQ  pair,  and  all  but  the  center  64  channels  were 
removed.  The  array  manifold  matrix  was  constructed  by  shifting  and  warping  the  spatial 
response  from  a  single  20  pm  diameter  stainless  steel  wire  embedded  in  the  same  7% 
acrylamide  gel  at  a  depth  of  2  cm.  Elevation  effects  were  not  modeled  for  this  set  of 
experiments.  Hypothetical  targets  were  placed  every  95.6  pm  axially  and  every  120  pm 
laterally  for  both  TONE  and  dTONE.  The  CIR  image  was  formed  using  a  64  element, 
300  pm  pitch  aperture  on  both  transmit  and  receive,  which  is  the  standard  configuration 
for  the  ultrasound  system  used.  The  transmit  beam  was  focused  at  2  cm  and  dynamic 
receive  focusing  was  applied  after  band-pass  filtering  and  apodization  with  a  Nuttall 
window. 

This  system  model  has  dimensions  13,632  x  18,471  samples  with  a  total  of  10,974 
fix  eigenvectors.  Images  were  formed  with  progressively  smaller  rank  in  order  to  asses 
the  computation  time  and  reconstruction  performance  for  dTONE  as  compared  to  qTONE 
using  both  simple  temporal  downsampling  as  well  as  SVD  rank  reduction.  For  qTONE, 
the  input  data  was  downsampled  temporally  by  a  factor  of  two  and  four  so  that  only 
6,848  and  3,424  input  samples  were  included,  respectively.  QTONE  was  also  rank 
reduced  to  those  same  levels  using  the  SVD  method  described  above.  Likewise,  for 
dTONE,  the  balance  between  fix  and  free  was  adjusted  so  that  only  6,848  and  3,424 


eigenvectors  were  included  in  the  fix  set.  In  this  way,  the  computation  time  and 
reconstruction  performance  of  dTONE  was  compared  with  those  of  the  two  qTONE 
methods  for  three  different  levels  of  rank  reduction. 

The  results  from  these  experiments  are  shown  in  Figure  1  through  Figure  3  and 
Table  1.  qTONE  using  both  temporal  downsampling  and  SVD  rank  reduction  achieves 
improved  image  quality  and  reduced  computation  time  compared  to  dTONE  in  the 
reduced  rank  examples.  Both  of  the  qTONE  methods  achieve  an  additional  computation 
cost  reduction  -  as  much  as  44%  -  due  to  the  reduced  memory  access  requirements. 
qTONE  at  rank  6,848  achieves  an  8.4  dB  contrast  improvement  over  full  rank  dTONE 
while  also  reducing  the  computation  time  by  a  factor  of  8. 
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Figure  1.  Experimental  images  of  an  anechoic  cyst  phantom  comparing  full  rank 
reconstruction  performance  of  CIR  (top),  rank  10,974  dTONE  (middle),  and  rank  13,696 
qTONE  (bottom).  All  images  are  log  compressed  to  50  dB. 
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Figure  2.  Experimental  images  of  an  anechoic  cyst  phantom  comparing  reduced  rank 
(rank  6848)  reconstruction  performance  of  dTONE  (top),  temporally  downsampled 
qTONE  (middle),  and  SVD  downsampled  qTONE  (bottom).  All  images  are  log 
compressed  to  50  dB. 
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Figure  3.  Experimental  images  of  an  anechoic  cyst  phantom  comparing  reduced  rank 
(rank  3424)  reconstruction  performance  of  dTONE  (top),  temporally  downsampled 


qTONE  (middle),  and  SVD  downsampled  qTONE  (bottom).  All  images  are  log 
compressed  to  50  dB. 


Table  1 .  Experimental  Comparison  of  Reduced  Rank  Image  Reconstruction 


Methods. 


Reconstruction 

Method 

Total  Memory 
(GB) 

Computation  Time 
(min) 

Cystic  Contrast 
(dB) 

CIR 

- 

- 

-6.4 

Rank 

10,974/13,632 

dTONE 

9.5 

64.6 

-14.4 

qTONE 

4.0 

61.3 

-14.9 

Rank  6,848 

dTONE 

9.5 

14.3 

-11.7 

qTONE  (temporal) 

2.0 

8.0 

-22.2 

qTONE  (SVD) 

3.5 

8.1 

-22.8 

Rank  3,424 

dTONE 

9.5 

4.4 

-10.8 

qTONE  (temporal) 

1.0 

2.8 

-10.4 

qTONE  (SVD) 

1.8 

2.9 

-11.9 

Animal  Tissue  Phantoms 

An  excised  mouse  heart  was  flushed  with  phosphate-buffered  solution  (PBS)  to 
remove  any  remaining  blood  from  the  chambers  and  then  embedded  at  a  depth  of  2  cm  in 
a  block  of  7%  acrylamide  gel.  Effort  was  taken  to  ensure  the  chambers  of  the  heart 
remained  in  an  open  state  by  backfilling  them  with  7%  acrylamide  prior  to  embedding  the 
heart.  Additionally,  a  3  cm  length  of  aorta  was  excised  from  a  rabbit,  flushed  with  PBS, 
and  backfilled  with  7%  acrylamide  prior  to  embedding  it  in  a  block  of  7%  acrylamide  at  a 
depth  of  2  cm.  Both  tissue  samples  were  then  imaged  using  the  same  parameters  used  for 
the  anechoic  cyst  phantom,  with  dTONE  operating  at  full  rank  (rank  10,974)  and  qTONE 
at  rank  6,848.  Again,  elevation  slice  thickness  was  not  modeled. 

Results  from  the  tissue  phantoms  are  shown  in  Figure  4.  True  quantitative 


measurements  couldn’t  be  made  in  the  animal  tissue  experiments  due  to  an  unknown 
ground  truth.  Although  both  dTONE  images  demonstrate  enhanced  contrast  and 
resolution,  delineation  of  tissue  boundaries  is  still  somewhat  difficult,  especially  in  the 
mouse  heart  image.  The  qTONE  images,  however,  show  a  superior  delineation  of  the 
boundary  between  the  septum  and  the  anechoic  ventricles  due  to  increased  contrast  when 
compared  to  dTONE.  In  addition,  the  increased  contrast  of  qTONE  comes  paired  with  an 
8x  reduction  in  computation  time  and  a  2.7x  reduction  in  memory  requirements. 
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Figure  4.  Experimental  excised  animal  tissue  reconstructions  using  CIR  (top  row),  full- 
rank  dTONE  (middle  row),  and  rank  6848  qTONE  (bottom  row).  The  left  column 
contains  reconstructions  of  an  excised  section  of  rabbit  aorta  and  the  right  column 
contains  a  long-axis  view  of  an  excised  mouse  heart.  Both  tissues  are  embedded  in 
acrylamide  gel.  All  images  are  log  compressed  to  50  dB. 


Discussion 


Images  reconstructed  using  the  dTONE  algorithm  display  significantly  improved 
resolution  and  contrast  when  compared  to  those  from  CIR.  The  enhanced  image  quality 
could  lead  to  improvements  in  diagnosis  sensitivity  and  specificity,  but  those  gains  come 
with  a  significant  increase  in  the  computation  required  to  reconstruct  images.  For 
dTONE  to  be  considered  as  a  viable  alternative  or  auxiliary  to  CIR,  the  reconstruction 
times  must  be  reduced  to  near  real-time  for  images  of  clinically  significant  dimensions. 
The  qTONE  algorithm  presented  here  successfully  reduced  the  computational  cost  by  a 
factor  of  eight  while  simultaneously  improving  the  measured  cystic  contrast  and  by  a 
factor  of  twenty  with  a  small  loss  in  image  quality.  By  combining  the  two  approaches, 
tiled  qTONE  could  achieve  reductions  in  computation  cost  of  more  than  4  orders  of 
magnitude  with  only  a  small  loss  in  image  quality. 

The  inclusion  of  noise  in  the  system  model,  as  in  (10),  is  important  for  the 
practical  application  of  qTONE  in  clinical  environments.  The  amount  of  regularization 
necessary  depends  heavily  upon  the  amount  of  noise  present  in  the  data,  which  varies 
depending  upon  the  type  of  tissue  being  imaged  and  at  what  depth.  Assuming  a  fixed 
amount  of  attenuation  in  specific  tissues,  we  can  vary  the  regularization  for  tiled  qTONE 
as  the  tiles  progress  in  depth.  Doing  so  will  ensure  that  each  tile  is  optimally 
reconstructed.  In  a  practical  implementation,  it  may  also  be  beneficial  to  have  a  user 
controllable  dial  that  would  increase  or  decrease  the  regularization  a  small  percent  from 
the  automatically  chosen  value. 

Although  [10]  demonstrates  dTONE’ s  robustness  to  electronic  noise  and  phase 
and  magnitude  aberration,  it  does  not  necessarily  follow  that  qTONE  has  similar 


robustness  characteristics.  To  fully  explore  these  traits,  a  similar  set  of  simulations 
should  be  performed  comparing  qTONE  to  both  dTONE  and  CIR.  Although  electronic 
noise  robustness  simulations  would  also  be  important,  the  40  dB  SNR  explored  in  this 
paper  might  prove  sufficient  given  dTONE ’s  single  transmit  event  requirement,  which 
enables  averaging  over  100  separate  transmits  in  less  than  0.01  seconds.  In  addition, 
other  methods  such  as  coded  excitation  could  be  used  to  ensure  high  SNR  levels,  even  at 
greater  depths  where  attenuation  significantly  reduces  SNR.  A  lower  transmit  pulse 
center  frequency  would  also  increase  the  SNR  at  the  expense  of  some  spatial  resolution 
and  be  less  susceptible  to  phase  aberration  errors. 

Conclusions 

In  this  paper,  an  alternative  to  the  dTONE  image  reconstruction  algorithm  - 
derived  form  the  same  foundations  -  is  derived  and  evaluated.  This  algorithm,  called 
Quick  TONE,  or  qTONE,  is  far  more  robust  than  dTONE  to  reductions  in  system  model 
rank.  As  a  result,  qTONE  can  reconstruct  images  of  equal  or  greater  contrast  with  far 
less  computational  and  memory  requirements.  In  addition,  a  sophisticated  approach  to 
reducing  the  qTONE  model  rank  is  presented  that  further  improves  the  algorithm’s 
robustness  to  rank  reduction.  For  the  system  models  tested  here,  qTONE  showed  an  8x 
decrease  in  computation  time,  but  this  difference  should  increase  as  the  size  of  the  model 
increases,  bringing  clinical  super-resolution  images  closer  to  reality. 
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Appendix  2 


Abstract: 

We  have  previously  introduced  a  new  image  reconstruction  method  that 
significantly  increases  both  image  contrast  and  resolution  and  described  important 
modifications  to  this  algorithm  that  increase  its  robustness  to  variations  from  the  model 
and  significantly  reduce  computation  costs.  The  modified  versions  of  this  algorithm, 
called  TONE,  were  validated  and  compared  to  CIR  techniques  through  application  to 
simulated  data  as  well  as  tissue  mimicking  phantoms  and  excised  animal  tissue. 
However,  these  simulations  and  experiments  were  conducted  under  a  limited  set  of 
conditions  that  don’t  necessarily  translate  well  to  clinical  imaging  environments.  Here 
we  reconstruct  the  first  set  of  in  vivo  images  using  all  of  the  techniques  introduced  in  this 
dissertation  and  qualitatively  compare  the  results  to  CIR.  In  the  two  different  in  vivo 
views  of  a  human  testicle  shown,  the  modified  TONE  reconstruction  demonstrates 
significant  improvement  in  image  quality  over  that  of  CIR. 


Introduction 


TONE  is  a  new  image  reconstruction  method  for  medical  ultrasound  that  is  based 
on  a  source  localization  technique  using  a  well-defined  system  model.  In  its  original 
form,  TONE  showed  significant  promise  for  increasing  resolution  and  contrast  of 
ultrasound  images,  but  was  not  well  suited  for  clinical  imaging  due  to  limited  robustness 
to  model  variations  and  significant  computational  costs.  We  have  previously  described  a 
modification  to  the  TONE  algorithm  that  improves  robustness  of  the  reconstruction  by 
modeling  hypothetical  scatterers  as  weighted,  diffuse  regions  of  scatterers  [1].  The 
modification,  called  diffuse-TONE,  or  dTONE,  proved  robust  to  electronic  noise  and 
aberration  in  simulated  datasets.  In  addition,  the  modified  algorithm  was  applied  to 
tissue  mimicking  phantoms  and  excised  animal  tissue  with  success.  We  have  also 
previously  described  a  method  to  achieve  much  of  the  computational  gains  from 
parallelization  with  little  of  the  loss  in  reconstruction  fidelity  [2],  The  approach  uses  rank 
reduction  to  efficiently  model  all  potential  sources  outside  the  borders  of  each  sub-model. 
In  both  simulation  and  experiment  with  tissue  mimicking  phantoms,  this  technique 
demonstrated  a  greater  than  ten-fold  reduction  in  computation  cost  with  only  a  small  loss 
in  image  quality.  We  have  also  described  an  alternative  algorithm  to  TONE,  called  quick- 
TONE,  or  qTONE,  that  is  derived  from  the  same  foundations  and  produces  nearly 
equivalent  or  better  results  with  further  reduced  computation  time. 

With  the  significant  computational  gains  of  tiled  qTONE  and  the  robustness 
improvements  of  dTONE,  in  vivo  imaging  is  now  possible  on  readily  available  hardware. 
In  this  paper  we  describe  an  experiment  imaging  a  human  testicle  in  vivo.  Reconstructed 
images  from  tiled  qTONE  are  shown  to  display  significant  improvements  in  image 


quality  and  feature  detectability  as  compared  to  CIR  methods. 


6.2  Experimental  Methods  and  Results 

An  Ultrasonix  Sonix  RP  system  employing  a  128  channel,  300  pm  pitch,  linear 
array  was  used  to  image  a  human  testicle  in  vivo.  A  6.6  MHz,  60%  -6dB  fractional 
bandwidth  plane  wave  was  used  on  transmit  and  single  channel  RF  data  was  received. 
The  received  data  was  filtered  using  a  100-tap  FIR  filter  with  a  pass-band  from  3-10 
MHz,  demodulated  to  produce  an  IQ  pair,  and  all  but  the  center  64  channels  were 
removed.  The  CIR  image  was  formed  using  a  64  element,  300  pm  pitch  aperture  on  both 
transmit  and  receive,  which  is  the  standard  configuration  for  the  ultrasound  system  used. 
The  transmit  beam  was  focused  at  2  cm  and  dynamic  receive  focusing  was  applied  after 
band-pass  filtering  and  apodization  with  a  Nuttall  window. 

The  array  manifold  matrix  was  constructed  by  shifting  and  warping  the  spatial 
response  from  a  single  20  pm  diameter  stainless  steel  wire  embedded  in  7%  acrylamide 
gel  at  a  depth  of  2  cm.  Elevation  effects  were  not  modeled  for  this  set  of  experiments. 
Hypothetical  scatterers  were  placed  every  95.6  pm  axially  and  every  120  pm  laterally 
over  a  4  cm  by  5  cm  region,  for  a  total  of  173,888  hypothetical  scatterers.  Although  the 
model  covered  a  5  cm  region  in  azimuth,  only  the  middle  3  cm  were  fully  reconstructed 
so  as  to  match  the  dimensions  of  the  CIR  image.  As  such,  the  outer  1  cm  on  each  side  in 
azimuth  were  rank  reduced  to  about  1/3  the  size  using  principal  component  analysis,  as 
described  in  [2],  The  model  used  for  these  experiments  thus  contains  104,500  full 
hypothetical  scatterers  and  about  22,900  reduced  rank  hypothetical  scatterers.  Along 
with  the  47,000  IQ  samples  for  each  hypothetical  scatterer,  the  total  memory  required  for 
such  a  model  is  96  GB.  The  fully  modeled  4  cm  by  3  cm  region  was  then  sub-divided 


into  8  tiles  with  50%  overlap  using  the  temporal  tiling  method  described  in  [2]  and  then 
processed  using  qTONE.  The  model  for  each  tile,  therefore,  contained  32,162  fully 
modeled  scatterers  and  31,800  reduced  rank  hypothetical  scatterers  and  required  10.7  GB 
of  memory.  The  total  reconstruction  time  for  all  tiles  computed  in  parallel  was  18.5 
minutes. 

The  Sonix  RP  system  used  for  this  study  does  not  have  the  capability  to  receive 
and  store  64  raw  RF  lines  in  parallel.  As  a  result,  64  separate  plane  wave  transmit  events 
were  required  to  obtain  the  necessary  data  for  tiled  qTONE.  This  additional  time 
requirement  for  data  acquisition  has  the  potential  to  introduce  motion  artifacts,  which 
could  severely  diminish  qTONE  reconstruction  quality.  To  compensate,  a  tracking  beam 
was  interspersed  at  a  constant  inverval  -  every  fifth  transmit  event  for  the  experiments  in 
this  paper  -  among  the  plane  wave  transmit,  single  channel  receive  events.  This  tracking 
beam  consists  of  a  transmit  focused  down  the  center  of  the  array  at  a  depth  of  2  cm  with 
dynamic  receive  focusing.  At  the  end  of  data  acquisition,  the  tracking  beams  were  parsed 
from  the  single  channel  data  and  the  beam-to-beam  displacements  were  determined  using 
cubic  spline  based  time  delay  estimation  [3],  The  required  motion  correction  for  each 
single  channel  data  line  was  then  calculated  using  cubic  interpolation  between  the 
displacements  of  the  surrounding  tracking  beams.  Finally,  the  motion  correction  was 
applied  using  cubic  spline  interpolation  to  shift  the  RF  data  lines. 

The  reconstructed  images  from  two  different  views  of  the  testicle  are  shown  in 
Figure  1  and  Figure  2.  As  the  ground  truth  anatomy  for  these  views  is  unknown,  only 
qualitative  analysis  can  be  conducted.  However,  in  both  image  views,  the  tiled  qTONE 
image  demonstrates  significantly  improved  delineation  of  tissue  boundaries  and  clutter 


reduction.  In  Figure  1,  there  are  two  distinct  oval  shaped  anechoic  regions  at  a  depth  of 
about  17  mm.  The  leftmost  of  these  two  regions  is  barely  detectable  in  the  CIR  image 
but  is  clearly  delineated  in  the  tiled  qTONE  image.  The  enhanced  contrast  and  resolution 
of  the  tiled  qTONE  reconstruction  also  shows  a  significant  increase  in  apparent  size  of 
the  rightmost  of  these  two  regions.  Very  similar  results  are  seen  in  the  anatomical  view 
of  Figure  2;  especially  with  the  three  anechoic  vessels  between  19  mm  and  23  mm  in 
range,  which  are  clearly  detected  in  the  tiled  qTONE  reconstruction  but  barely  visible  in 
the  CIR  image. 
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Figure  1.  In  vivo  CIR  (top)  and  tiled  qTONE  (bottom)  images  of  a  human  testicle.  All 
images  log  compressed  to  50  dB. 
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Figure  2.  In  vivo  CIR  (top)  and  tiled  qTONE  (bottom)  images  of  a  human  testicle.  All 
images  log  compressed  to  50  dB. 


Discussion 


The  results  shown  in  this  paper  are  the  first  demonstration  of  a  source  localization 
technique  applied  to  in  vivo  ultrasound  data.  Although  the  anatomy  of  the  imaged  tissue 
-  a  human  testicle  -  isn’t  overly  complex,  there  are  enough  tissue  boundaries  and  features 
to  highlight  tiled  qTONE’s  benefits  over  CIR  methods.  The  significant  increase  in 
resolution  and  contrast  of  tiled  qTONE  bring  out  otherwise  undetectable  features  in  the 
anatomy  shown  in  these  images.  Additionally,  tiled  qTONE  shows  enhanced  tissue 
boundary  delineation  for  those  features  that  are  detected  in  the  CIR  images.  Such 
improvements  could  have  significant  implications  for  the  diagnostic  capabilities  of 
medical  ultrasound.  The  ability  to  reliably  resolve  features  such  as  spiculation  [4]  or 
microcalcifications  [5-7]  in  breast  imaging,  for  example,  could  lead  to  earlier  and  more 
accurate  diagnoses  and  may  even  cause  ultrasound  to  supplant  mammography  in  certain 
applications. 

The  system  model  matrix  used  in  these  experiments  was  not  formed  in  an  ideal 
manner  for  optimal  reconstruction  performance.  The  system  response  of  each 
hypothetical  scatterer  was  determined  by  shifting  and  warping  the  measured  response 
from  a  20  pm  diameter  stainless  steel  wire  embedded  in  7%  acrylamide  gel,  making  it  a 
hybrid  of  an  experimental  and  a  theoretical  model.  This  process  of  shifting  and  warping 
a  single  measured  response  is  prone  to  introducing  artifacts  in  the  reconstructed  image,  as 
it  does  not  take  into  account  factors  such  as  element  directivity  and  frequency  dependent 
attenuation.  Ideally  the  system  model  matrix  would  be  determined  entirely  through 
experiment,  mimicking  in  vivo  acoustic  parameters  as  closely  as  possible.  Using  such  a 
system  model  should  be  expected  to  result  in  higher  quality  reconstructions  with  reduced 


image  artifact. 


The  tiled  qTONE  image  reconstructions  in  this  paper  took  approximately  18.5 
minutes  to  compute  in  parallel  on  eight  2.33  GHz  processors.  While  this  amount  of  time 
is  reasonable  for  laboratory  experiments,  it  would  not  suffice  for  clinical  imaging 
environments,  where  real-time  reconstruction  is  essential.  Nevertheless,  there  are  several 
possibilities  for  further  reducing  computation  time  to  achieve  real-time  reconstruction. 
Thanks  to  continuing  computational  advances,  there  currently  exist  off-the-shelf  systems 
capable  of  4  TFLOPS,  with  more  than  400  GB/s  memory  bandwidth  (Nvidia®  Tesla™ 
S2070).  Using  such  a  system  would  bring  the  reconstruction  time  for  the  images  shown 
in  this  paper  down  from  18.5  minutes  to  0.5  seconds.  Although  that  is  still  about  an  order 
of  magnitude  short  of  real-time  image  reconstruction,  there  is  potential  to  reduce 
computation  time  further  by  breaking  the  reconstruction  up  into  more  tiles. 

Conclusions 

In  this  paper,  all  of  the  previously  described  TONE  methods  were  applied  to  in 
vivo  data  from  a  human  testicle.  The  result  is  the  first  application  of  a  source  localization 
technique  to  in  vivo  ultrasound  data.  The  tiled  qTONE  images  show  a  marked 
improvement  in  tissue  boundary  delineation  and  contrast  when  compared  to  their  CIR 
counterparts.  Although  the  tiled  qTONE  images  in  this  paper  required  18.5  minutes  to 
reconstruct,  off-the-shelf  hardware  is  available  that  would  bring  the  computation  time 
down  to  0.5  seconds.  Further  reconstruction  time  reductions  could  also  be  achieved  by 
increasing  the  number  of  tiles  used,  bringing  real-time  super-resolution  imaging  closer  to 
reality. 
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